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[ABSTRACT] 

[Abstract] 

The present invention relates to a method of producing face description that 
applies general discriminant analysys (GDA) to linear discriminant analysis (LDA) 
components, which achieves a more accurate face-recognition rate. The final face 
description is produced by margining the LDA projection extracted by face elements as 
a single vector, and using the GDA. 

[Representative Drawing] 
FIG 1 
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[SPECIFICATION] 



[Title of the Invention] 

Method of Producing Face Description by Applying GDA to LDA Projections 

[Brief Description of the Drawings] 

FIG. 1 illustrates the whole procedure that applies GDA to LDA components 
according to an embodiment of the present invention. 

[Detailed Description of the Invention] 
[Object of the Invention] 

[Field of the Invention and Description of the Related Art] 

The present invention relates to a method of producing face description that 
applies general discriminant analysys (GDA) to linear discriminant analysis (LDA) 
components, which achieves a more accurate face-recognition rate. 

The GDA is an existing technology, but a more accurate face-recognition rate 
has been achieved when it is applied to LDA result values extracted by face elements. 

[Technical Aspects to be achieved by the Invention] 

An object of the present invention is to achieve a more accurate face- 
recognition rate by applying GDA to LDA result values extracted by face elements. 

In order to achieve the object, the present invention produces the final face 
description by margining the LDA projection extracted by face elements as a single 
vector, and using the GDA. 

[Embodiments and Operations of the Invention] 

The present invention will be described in detail with reference to the attached 
drawings. 

FIG. 1 illustrates the whole procedure that applies GDA to LDA components 
according to an embodiment of the present invention. 



GDA is a method designed for non-linear feature extraction. The object of 
GDA is to find a non-linear transformation that maximizes the ratio between the 
between-class variance and the total variance of transformed data. In the linear case, 
maximization of the ratio between the variances is achieved via the eigenvalue 
decomposition similar to LDA. 

The non-linear extension is performed by mapping the data from the original 
space y to a new high dimensional feature space Z by a function 0: Y-^Z, The 
problem of high dimensionality of the new space Z is avoided using a kernel function k: 
YxY-^R. The value of the kernel function k(yi,yj) is equal to the dot product of non- 
linearly mapped vectors <t> (yO and 0(yj), i.e., k(yi, yj)=0(yi)^0(yj)9 which can be 
evaluated efficiently without explicit mapping the data into the high dimensional space. 

It is assumed that yuj denotes the i-^ training pattern of k-^ class, M is the 

M 

number of classes, Ni is the number of patterns in the i-^ class, and ^ = ^^k denotes 

the number of all patterns. If it is assumed that the data are centered, the total scatter 
matrix of the non-linearly mapped data is 

1 M Nt 

The between-class scatter matrix of non-linearly mapped data is defined as 

1 M 

1 ^' 

where <^i^^ ) = TT" Z ^^y^-i > • 

The aim of the GDA is to find such projection vectors w eZ which maximize the 

ratio 



It is well known that the vectors w sZ maximizing the ratio, such as Equation 1 , 
can be found as the solution of the generalized eigenvalue problem 

ASj^w = SgW (2) 

where A is the eigenvalue corresponding to the eigenvector w. 

To employ the kernel functions all computations must be carried out in terms of 
dot products. To this end, the projection vector w is expressed as a linear combination of 
training patterns, i.e., 

where a^j are some real weights. Using Equation 3, Equation 1 can be expressed as 

X = — J. (4) 

a' KKa 

where the vector a=^a^, k=J,.,,, M and ak^(akj, i=l,„.,Nk, The kernel matrix K 
(NxN) is composed from the dot products of non-linearly mapped data, i.e., 

K=(Kk,i)k=J M, 1=1.. ..M (5) 

where K,j ^ (k(y,^,,y, j)),^, at, j=i...jv, • 

The matrix W (NxN) is a block diagonal matrix 

W^(W0,^! M (6) 



where k-^ matrix Wk on the diagonal has all elements which are equal to — ^ . 

Solving the eigenvalue problem Equation 6 yields the coefficient vectors a that 
define the projection vectors w eZ. A projection of a testing vector is computed as 

*=1 i=l 



1 



As mentioned above, the training vectors are supposed to be centered in the 
feature space Z. The centered vector 0(y) ' is computed as 

1 M 

<^{yy=^{y)--YL^{y,^^ (8) 

which can be done imphcitly using the centered kernel matrix K' (instead of K) since the 
data appears in terms of dot products only. The centered kernel matrix K* is computed 
as 



K'==K- — IK- — KI — \-IKI (9) where 



matrix / (NxN ) has all elements equal to L Similarly, a testing vector y must be 
centered by Equation 8 before projecting by Equation 7. Application of Equations 8 
and 7 to the testing vector is equivalent to using the following term for projection 

w''0(yy= X Z A,^(>'*, ,y) + b (10) 

k=\ i=\ 

The centered coefficients /^kj are computed as 

P,j=a,,-^Ja (11) 
and bias b as 



b = -—JKJa + -^JceJKJ (12) 
N N"" 



where the column vector J (Nxl) has all terms equal to 1. 



The whole GDA procedure can be summarized as the following: 



1 . Concentrated kernel matrix K' (9) (5) and matrix W{6) are calculated. 



2. Coefficient vector a is calculated by solving a generalized unique value problem 
(4). 

3. Coefficient vector /? (1 1) and bias 6(12) are calculated. 

4. The projection of vector >^ is calculated using equation 10. 

The component-based LDA face descriptor (CLFD) describes /th training vector x, 
by the LDA-projected characteristic vector set of a certain area of a 

processed face x/. All characteristic vectors are merged as a single vector 
yi = [>'/ jjv/ v ^x' ] J and a related characteristic vector z, is extracted using the GDA, 
The wrhole procedure is summarized as the following: 

1 . LDA components y\ , y] ,.. 5 J^f for each training face Xj are calculated. 

2. Each face is described by merging all components as a single vector 

3. The GDA procedure is applied to vector yi.that produces new expression Zj. 
Refer to FIG. 1 for the description of the whole procedure. 

Experiment 

The suggested try has been tested in the face-modifying experiment. The 
MPEG and ALTKOM face database has been used for the experiment. The 5 



experiments have been performed by the training and partitioning on the testing set 
described in Table 1 . 



Table 1 





Training Set 


Testing Set 


Experiment 1 
(MPEG) 


200 images: 

40 persons * 5 images/ 
1 person 

mpeg_0066_01- mpeg^OO 

85_05 

mpeg_0l81_01- 
mpeg_0200_05 


2975 images: 

595 persons* 5 images/1 person 

(All image files - Training set used by version 

1 descriptor) 


Experiment 2 
(MPEG) 


800 image: 

160 persons * 5 images / 

1 person 

(Image field where human 

ID field is xxx2 or xxx4 + 

Training set used by 

version 1 descriptor) 


2375 images: 

475 persons * 5 images /I person 

(All image files - Image field where human ID 

field is xxx2 or xxx4 - Training set used by 

version 1 descriptor) 


Experiment 3 
(MPEG) 


1685 images: 

337 Dersons * 5 images/ 

1 person 

(Image file where human I 
D field is good + Training s 
et used by version 1 descrip 
tor) 


1 490 imaofes* 

298 persons * 5 image /I person 
(Image file where human ID field is a cardinal 
number — 
Training set used by version 1 descriptor) 


Experiment 4 
(MPEG+ALTKOM) 
[Training: Test =1:4] 


1035 images: 

(Image file where human I 
D field is 
xxxl or xxx6 + Training set 
used by version 1 descript 
or) 


3340 images: 

(All image files - Image file - 
training set used by version 1 descriptor) 



Experiment 5 


2285 images: 






2090 images: 




(Image file where human I 


(MPEG+ ALTKOM) 


(Image file where human ID field is a cardinal 


D field is good + Training s 




number - 


[Training: Test =1:1] 


et used by version 1 descrip 


Training set used by version 1 descriptor) 


tor) 





In special cases, each face Xi is described as 5 LDA component vectors 
yl^yfy-'^yf and l LDA projection of the v^hole face yf. Projection yf is indicated 
as the projection as a whole. From the merged vector;/, 25 most important coordinates 
out of each component y] ^yf ,,.,,yf , and 50 most important coordinates out of the 

whole projection yf are used. In conclusion, 5x25+50=7 75-dimensional vector 
=[yUyf^'-,yf] is obtained. 



Four different faces have been compared as the following. 

1 . The whole descriptor face is described by 50 most important coordinates among 
the whole LDA projection yf . 

2. The merged descriptor face is described by 7 75-dimensional merged vector 

y. ^[y]^yf^-,yf]' 

3. The merged LDA descriptor face is described by 50 most important coordinates 
out of LDA projection of the merged vector y^ = [y] , yf yf ] , 



4. The merged GDA descriptor face is described by 50 most important coordinates 
out of GDA projection of the merged vector = [y] ^yf ^...^yf]. 

The GDA procedure makes the use of the vast kernel function defining the linear or 
nonlinear characteristic extraction possible. RBF(Radial Basis Function) kernel 

^(X >>'y) "^^^ been used, and the kernel width is experimentally 

determined so that the best ANMRR rate can be produced. 

In the experiment (i) ANMRR(Average Normalized Modified Recognition Rate) 
and (ii) FIR(False Identification Rate) for the testing set have been measured. 

The Table 2 describes the result of the experiment. The result shows that the 
merged GDA descriptor has better performance, exempting the experiment 1. In the 
case of the experiment 1 , the performance of the merged GDA is weak because of the 
over-training effect as the training set consists of only 300 faces. 



Table 2 





Experiment 1 


Experiment 2 


Experiment 3 


Experiment 4 


Experiment 5 




ANMRR 


FIR 


ANMRR 


FIR 


ANMRR 


FIR 


ANMRR 


FIR 


ANMRR 


FIR 


Whole 


0.1701 


0,0666 


0.1448 


0.0573 


0.1267 


0.0477 


0.2911 


0.1060 


0,1950 


0.0641 


Merged 


0.1391 


0.0491 


0.1190 


0.0421 


0.1061 


0.0336 


0.2293 


0.0641 


0,1543 


0.0373 


Merged- 
LDA 


0,3565 


0,1983 


0.1257 


0.0467 


0.0898 


0.0222 


0.2457 


0.0731 


0,1466 


0,0368 



Merged- 


0.2547 


0.1318 


0.1031 


0.0358 


0.0677 


0.0168 


0.2129 


0.0545 


0.1108 


0.0239 


GDA 























[Effects of the Invention] 

According to the present invention, a more accurate face-recognition rate can 

be achieved. 



[Claims] 

1 . A method of producing a face description that applies the GDA to the LDA 
projection, where the LDA projection extracted by face elements is merged as a single 
vector, and the final face description is produced using the GDA. 



Drawings 



Fig 1. 




Input face 



iVierged vector Final face description 



